Trends in HCAHPS Survey Scores, 2008-2019: A Quality Improvement Perspective.

BACKGROUND: HCAHPS' 2008 initial public reporting, 2012 inclusion in the Hospital Value-Based Purchasing Program (HVBP), and 2015 inclusion in Hospital Star Ratings were intended to improve patient experiences. OBJECTIVES: Characterize pre-COVID-19 (2008-2019) trends in hospital consumer assessment of healthcare providers and systems (HCAHPS) scores. RESEARCH DESIGN: Describe HCAHPS score trends overall, by phase: (1) initial public reporting period (2008-2013), (2) first 2 years of HVBP (2013-2015), and (3) initial HCAHPS Star Ratings reporting (2015-2019); and by hospital characteristics (HCAHPS decile, ownership, size, teaching affiliation, and urban/rural). SUBJECTS: A total of 3909 HCAHPS-participating US hospitals. MEASURES: HCAHPS summary score (HCAHPS-SS) and 9 measures. RESULTS: The mean 2007-2019 HCAHPS-SS improvement in most-positive-category ("top-box") responses was +5.2 percentage points/pp across all hospitals (where differences of 5pp, 3pp, and 1pp are "large," "medium," and "small"). Improvement rate was largest in phase 1 (+0.8/pp/year vs. +0.2pp/year and +0.1pp/year for phases 2 and 3, respectively). Improvement was largest for Overall Rating of Hospital (+8.5pp), Discharge Information (+7.3pp), and Nurse Communication (+6.5pp), smallest for Doctor Communication (+0.8pp). Some measures improved notably through phases 2 and 3 (Nurse Communication, Staff Responsiveness, Overall Rating of Hospital), but others slowed or reversed in Phase 3 (Communication about Medicines, Quietness). Bottom-decile hospitals improved more than other hospitals for all measures. CONCLUSIONS: All HCAHPS measures improved rapidly 2008-2013, especially among low-performing (bottom-decile) hospitals, narrowing the range of performance and improving scores overall. This initial improvement may reflect widespread, general quality improvement (QI) efforts in lower-performing hospitals. Subsequent slower improvement following the introduction of HVBP and Star Ratings may have reflected targeted, resource-intensive QI in higher-performing hospitals.

Differential Privacy Protections in 2020 U.S. Decennial Census Data Do Not Impede Measurement of Racial and Ethnic Disparities.

Census data are vital to health care research but must also protect respondents' confidentiality. The 2020 decennial Census employs a new Differential Privacy framework; this study examines its effect on the accuracy of an important tool for measuring health disparities, the Bayesian Improved Surname and Geocoding (BISG) algorithm, which uses Census Block Group data to estimate race and ethnicity when self-reported data are unavailable. Using self-reported race and ethnicity data as our standard, we compared the accuracy of BISG estimates calculated using the original 2010 Census counts to the accuracy of estimates calculated using 2010 data but with 2020 Differential Privacy in place. The Differential Privacy methodology slightly decreases BISG accuracy for American Indian and Alaska Native people but has little effect for other groups, suggesting that the methodology will not impede health disparities research that employs BISG and similar methods.

Which medicare advantage enrollees are at highest one-year mortality risk?

BACKGROUND: While a number of tools exist to predict mortality among older adults, less research has described the characteristics of Medicare Advantage (MA) enrollees at higher risk for 1 year mortality. OBJECTIVES: To describe the characteristics of MA enrollees at higher mortality risk using patient survey data. RESEARCH DESIGN: Retrospective cohort. SUBJECTS: MA enrollees completing the 2019 MA Consumer Assessment of Healthcare Providers and Systems (CAHPS) Survey. MEASURES: Linked demographic, health, and mortality data from a sample of MA enrollees were used to predict 1-year mortality risk and describe enrollee characteristics across levels of predicted mortality risk. RESULTS: The mortality model had a 0.80 c-statistic. Mortality risks were skewed: 6 % of enrollees had a ≥ 10 % 1-year mortality risk, while 45 % of enrollees had 1 % to < 5 % 1-year mortality risk. Among the high-risk (≥10 %) group, 47 % were age 85+ versus 12 % among those with mortality risk <5 %. 79 % were in fair or poor self-rated health versus 29 % among those with mortality risk of <5 %. 71 % reported needing urgent care in the prior 6 months versus 40 % among those with a mortality risk of 1 to<5 %. CONCLUSIONS: Relatively few older adults enrolled in MA are at high 1-year mortality risk. Nonetheless, MA enrollees over age 85, in fair or poor health, or with recent urgent care needs are far more likely to be in a high mortality risk group.

Assessing the accuracy of race-and-ethnicity data in the Outcome and Assessment Information Set.

BACKGROUND: Limitations in the quality of race-and-ethnicity information in Medicare's data systems constrain efforts to assess disparities in care among older Americans. Using demographic information from standardized patient assessments may be an efficient way to enhance the accuracy and completeness of race-and-ethnicity information in Medicare's data systems, but it is critical to first establish the accuracy of these data as they may be prone to inaccurate observer-reported or third-party-based information. This study evaluates the accuracy of patient-level race-and-ethnicity information included in the Outcome and Assessment Information Set (OASIS) submitted by home health agencies. METHODS: We compared 2017-2022 OASIS-D race-and-ethnicity data to gold-standard self-reported information from the Medicare Consumer Assessment of Healthcare Providers and Systems® survey in a matched sample of 304,804 people with Medicare coverage. We also compared OASIS data to indirect estimates of race-and-ethnicity generated using the Medicare Bayesian Improved Surname and Geocoding (MBISG) 2.1.1 method and to existing Centers for Medicare & Medicaid Services (CMS) administrative records. RESULTS: Compared with existing CMS administrative data, OASIS data are far more accurate for Hispanic, Asian American and Native Hawaiian or other Pacific Islander, and White race-and-ethnicity; slightly less accurate for American Indian or Alaska Native race-and-ethnicity; and similarly accurate for Black race-and-ethnicity. However, MBISG 2.1.1 accuracy exceeds that of both OASIS and CMS administrative data for every racial-and-ethnic category. Patterns of inconsistent reporting of racial-and-ethnic information among people for whom there were multiple observations in the OASIS and Consumer Assessment of Healthcare Providers and Systems (CAHPS) datasets suggest that some of the inaccuracies in OASIS data may result from observation-based reporting that lessens correspondence with self-reported data. CONCLUSIONS: When health record data on race-and-ethnicity includes observer-reported information, it can be less accurate than both true self-report and a high-performing imputation approach. Efforts are needed to encourage collection of true self-reported data and explicit record-level data on the source of race-and-ethnicity information.

Narrative comments about pediatric inpatient experiences yield substantial information beyond answers to closed-ended CAHPS survey questions.

PURPOSE: Adults' comments on patient experience surveys explain variation in provider ratings, with negative comments providing more actionable information than positive comments. We investigate if narrative comments on the Consumer Assessment of Healthcare Providers and Systems (CAHPS®) survey of inpatient pediatric care (Child HCAHPS) account for global perceptions of the hospital beyond that explained by reports about specific aspects of care. METHODS: We analyzed 545 comments from 927 Child HCAHPS surveys completed by parents and guardians of hospitalized children with at least a 24-h hospital stay from July 2017 to December 2020 at an urban children's hospital. Comments were coded for valence (positive/negative/mixed) and actionability and used to predict Overall Hospital Rating and Willingness to Recommend the Hospital along with Child HCAHPS composite scores. RESULTS: Comments were provided more often by White and more educated respondents. Negative comments and greater actionability of comments were significantly associated with Child HCAHPS global rating measures, controlling for responses to closed-ended questions, and child and respondent characteristics. Each explained an additional 8% of the variance in respondents' overall hospital ratings and an additional 5% in their willingness to recommend the hospital. CONCLUSIONS: Child HCAHPS narrative comment data provide significant additional information about what is important to parents and guardians during inpatient pediatric care beyond closed-ended composites. PRACTICE IMPLICATIONS: Quality improvement efforts should include a review of narrative comments alongside closed-ended responses to help identify ways to improve inpatient care experiences. To promote health equity, comments should be encouraged for racial-and-ethnic minority patients and those with less educational attainment.

Survey Protocols, Response Rates, and Representation of Underserved Patients: A Randomized Clinical Trial.

Importance: Surveys often underrepresent certain patients, such as underserved patients. Methods that improve their response rates (RRs) would help patient surveys better represent their experiences and assess equity and equity-targeted quality improvement efforts. Objective: To estimate the effect of adding an initial web mode to existing Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey protocols and extending the fielding period on RR and representativeness of underserved patient groups. Design, Setting, and Participants: This randomized clinical trial included 36 001 patients discharged from 46 US hospitals from May through December 2021. Data analysis was performed from May 2022 to September 2023. Exposures: Patients were randomized to 1 of 6 survey protocols: 3 standard HCAHPS protocols (mail only, phone only, mail-phone) plus 3 web-enhanced protocols (web-mail, web-phone, web-mail-phone). Main Outcomes and Measures: RR and number of respondents per 100 survey attempts (yield) were calculated and compared for each of the 6 survey protocols, overall, and by patient age, service line, sex, and race and ethnicity. Results: A total of 34 335 patients (median age range, 55-59 years; 59.3% female individuals and 40.7% male individuals) were eligible and included in the study. Of the respondents, 6.9% were Asian American or Native Hawaiian or Other Pacific Islander, 0.7% were American Indian or Alaska Native, 11.5% were Black, 17.4% were Hispanic, 61.0% were White, and 2.6% were multiracial. Of the 6 protocols, RRs were highest in web-mail-phone (36.5%), intermediate for the 3 two-mode survey protocols (mail-phone, web-mail, web-phone, 30.3%-31.1%), and lowest for the 2 single-mode protocols (mail only, phone only, 22.1%-24.3%). Web-mail-phone resulted in the highest yield for 3 racial and ethnic groups (Black, Hispanic, and White patients) and second highest for another (multiracial patients). Otherwise, the highest or second highest yield was almost always a 2-mode protocol. Mail only was the lowest-yield protocol for Black, Hispanic, and multiracial patients and phone-only was the lowest-yield protocol for White patients; these 2 protocols tied for lowest-yield for Asian American or Native Hawaiian or Other Pacific Islander patients. Gains from multimode approaches were often 2 to 3 times as large for Asian American or Native Hawaiian or Other Pacific Islander, Black, Hispanic, and multiracial patients as for White patients. Web-mail-phone had the highest RR for 6 of 8 age groups and 4 of 5 combinations of service line and sex. Conclusions and Relevance: In this randomized clinical trial, web-first multimode survey protocols significantly improved the RR and representativeness of patient surveys. The best-performing protocol based on RR and representativeness was web-mail-phone. Web-phone performed well for young and diverse patient populations, and web-mail for older and less diverse patient populations. The US Centers for Medicare & Medicaid Services will allow hospitals to use the web-mail, web-phone, and web-mail-phone protocols for HCAHPS administration beginning in 2025.

Interventions and Hospital Characteristics Associated With Patient Experience: An Update of the Evidence.

Patient experience is a key hospital quality measure. We review and characterize the literature on interventions, care and management processes, and structural characteristics associated with better inpatient experiences as measured by the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) survey. Prior reviews identified several promising interventions. We update these previous efforts by including more recent peer-reviewed literature and expanding the review's scope to include observational studies of HCAHPS measures with process measures and structural characteristics. We used PubMed to identify U.S. English-language peer-reviewed articles published in 2017 to 2020 and focused on hospital patient experience. The two HCAHPS domains for which we found the fewest potential quality improvement interventions were Communication with Doctors and Quietness. We identified several modifiable processes that could be rigorously evaluated in the future, including electronic health record patient engagement functionality, care management processes, and nurse-to-patient ratios. We describe implications for future policy, practice, and research.

Performance of the Physical Functioning Activities of Daily Living Scale in the 2020 Medicare Health Outcomes Survey.

OBJECTIVE: Assessing functional limitations for adults at high risk of frailty yields valuable information for identifying those in need of therapy. We evaluate a self-report measure used to assess physical function among Medicare recipients in the United States. DESIGN: Secondary analysis of the 2020 Medicare Health Outcomes Survey. SETTING: A random sample of adult enrollees of 510 managed care plans. PARTICIPANTS: 287,476 adults (37% completion rate): 58% women; 16% were <65 years old (entitled via disability), 50% 65-74, and 34% 75 or older; 77% White, 14% Black, and 8% another race; 19% had

Do Hospital Characteristics Predict Racial-and-Ethnic Disparities in Patient Experience? National Results From the HCAHPS Survey.

OBJECTIVE: Assess whether hospital characteristics associated with better patient experiences overall are also associated with smaller racial-and-ethnic disparities in inpatient experience. BACKGROUND: Hospitals that are smaller, non-profit, and serve high proportions of White patients tend to be high-performing overall, but it is not known whether these hospitals also have smaller racial-and-ethnic disparities in care. RESEARCH DESIGN: We used linear mixed-effect regression models to predict a summary measure that averaged eight Hospital CAHPS (HCAHPS) measures (Nurse Communication, Doctor Communication, Staff Responsiveness, Communication about Medicines, Discharge Information, Care Coordination, Hospital Cleanliness, and Quietness) from patient race-and-ethnicity, hospital characteristics (size, ownership, racial-and-ethnic patient-mix), and interactions of race-and-ethnicity with hospital characteristics. SUBJECTS: Inpatients discharged from 4,365 hospitals in 2021 who completed an HCAHPS survey ( N =2,288,862). RESULTS: While hospitals serving larger proportions of Black and Hispanic patients scored lower on all measures, racial-and-ethnic disparities were generally smaller for Black and Hispanic patients who received care from hospitals serving higher proportions of patients in their racial-and-ethnic group. Experiences overall were better in smaller and non-profit hospitals, but racial-and-ethnic differences were slightly larger. CONCLUSIONS: Large, for-profit hospitals and hospitals serving higher proportions of Black and Hispanic patients tend to be lower performing overall but have smaller disparities in patient experience. High-performing hospitals might look at low-performing hospitals for how to provide less disparate care whereas low-performing hospitals may look to high-performing hospitals for how to improve patient experience overall.

A Formal Framework For Incorporating Equity Into Health Care Quality Measurement.

Quality measurement is an important tool for incentivizing improvement in the quality of health care. Most quality measurement efforts do not explicitly target health equity. Although some measurement approaches may intend to realign incentives to focus quality improvement efforts on underserved groups, the extent to which they accomplish this goal is understudied. We posit that tying incentives to approaches on the basis of stratification or disparities may have unintended consequences or limited effects. Such approaches might not reduce existing disparities because addressing one aspect of equity may be in competition with addressing others. We propose equity weighting, a new measurement framework to advance equity on multiple fronts that addresses the shortcomings of existing approaches and explicitly calibrates incentives to align with equity goals. We use colorectal cancer screening data derived from 2017 Medicare claims to illustrate how equity weighting fixes unintended consequences in other methods and how it can be adapted to policy goals.

Exploring Which Patients Use Their Closest Emergency Departments Using Geocoded Data.

BACKGROUND: Each year, roughly 20% of U.S. adults visit an emergency department (ED), but little is known about patients' choice of ED. OBJECTIVES: Examine the discretion patients have to choose among EDs, characteristics associated with ED choice, and relationship between ED choice and self-reported care experiences of ED patients. METHODS: We surveyed adult patients discharged to the community (DTC) in January-March 2018 from 16 geographically dispersed hospital-based EDs, geocoded patient and hospital-based ED addresses within 100 miles of patient addresses, and calculated travel distances. We examined the likelihood of visiting the closest ED based on patient and ED characteristics. Linear regression models examined the association of choosing the closest ED with seven measures of patient experience of care (scaled 0-100), adjusting for patient characteristics. RESULTS: 43.6% of 4647 responding patients visited the ED nearest their home (on average, 5.7 miles away). Patients who chose a farther ED had more urgent conditions, were more educated, and were less likely to be non-Hispanic White. They were significantly more likely to have visited an ED in a higher-rated, metropolitan, network hospital with major teaching status, a cardiac intensive care unit, and a certified trauma center. Patients who chose a farther ED were more likely to recommend that ED, with "medium-to-large" differences in scores (+4.3% more selected "definitely yes", p < 0.05). CONCLUSIONS: Fewer than half of patients visited the closest ED. Patients who chose a farther ED tended to seek higher-rated hospitals and report more favorable experiences.

Changes in Patient Experiences of Hospital Care During the COVID-19 Pandemic.

Importance: It is important to assess how the COVID-19 pandemic was adversely associated with patients' care experiences. Objective: To describe differences in 2020 to 2021 patient experiences from what would have been expected from prepandemic (2018-2019) trends and assess correlates of changes across hospitals. Design, Setting, and Participants: This cohort study compared 2020 to 2021 data with 2018 to 2019 data from 3 900 887 HCAHPS respondents discharged from 3381 HCAHPS-participating US hospitals. The data were analyzed from 2022 to 2023. Main Outcomes and Measures: The primary outcome was an HCAHPS summary score (HCAHPS-SS), which averaged 10 HCAHPS measures. The primary analysis estimated whether HCAHPS scores from patients discharged from 2020 to 2021 differed from scores that would be expected based on quarterly and linear trends from 2018 to 2019 discharges. Secondary analyses stratified hospitals by prepandemic overall star ratings and staffing levels. Results: Of the 3 900 887 HCAHPS 2020 to 2021 respondents, 59% were age 65 years or older, and 35% (11%) were in the surgical (maternity) service lines. Compared with trends expected based on prepandemic (2018-2019) data, HCAHPS-SS was 1.2 percentage points (pp) lower for quarter (Q) 2/2020 discharges and -1.9 to -2.0 pp for Q3/2020 to Q1/2021, which then declined to -3.6 pp by Q4/2021. The most affected measures (Q4/2021) were staff responsiveness (-5.6 pp) and cleanliness (-4.9 pp); the least affected were discharge information (-1.6 pp) and quietness (-1.8 pp). Overall rating and hospital recommendation measures initially exhibited smaller-than-average decreases, but then fell as much as the more specific experience measures by Q2/2021. Quietness did not decline until Q2/2021. The HCAHPS-SS fell most for hospitals with the lowest prepandemic staffing levels; hospitals with bottom-quartile staffing showed the largest decrements, whereas top-quartile hospitals showed smaller decrements in most quarters. Hospitals with better overall prepandemic quality showed consistently smaller HCAHPS-SS drops, with effects for 5-star hospitals about 25% smaller than for 1-star and 2-star hospitals. Conclusions and Relevance: The results of this cohort study of HCAHPS-participating hospitals found that patient experience scores declined during 2020 to 2021. By Q4/2021, the HCAHPS-SS was 3.6 pp lower than would have been expected, a medium effect size. The most affected measures (staff responsiveness and cleanliness) showed large effect sizes, possibly reflecting high illness-associated hospital workforce absenteeism. Hospitals that were lower performing and less staffed prepandemic may have been less resilient to reduced staff availability and other pandemic-associated challenges. However, by Q4/2021, even prepandemic high-performing hospitals had similar declines.

Refining United States Sexual Minority Adult Population Estimates with the Inclusion of "Something Else" and "Don't Know" Survey Responses.

Purpose: To refine estimates of the U.S. sexual minority population, we sought to characterize trends in the odds of respondents selecting "something else" or "don't know" when asked about sexual orientation on the National Health Interview Survey and to reclassify those respondents likely to be sexual minority adults. Methods: Logistic regression was conducted to test whether the odds of selecting "something else" or "don't know" increased over time. A previously established analytic approach was used to identify sexual minority adults among these respondents. Results: Between 2013 and 2018, the percentage of respondents selecting "something else" or "don't know" increased 2.7-fold, from 0.54% to 1.44%. Reclassifying respondents with >50% predicted probabilities of being sexual minorities increased sexual minority population estimates by as much as 20.2%. Conclusion: A growing proportion of adults are selecting "something else" or "don't know." Properly classifying these responses yields more accurate sexual minority population estimates.

Stress-induced Changes in Autonomic Reactivity Vary with Adolescent Violence Exposure and Resting-state Functional Connectivity.

Exposure to violence during childhood can lead to functional changes in brain regions that are important for emotion expression and regulation, which may increase susceptibility to internalizing disorders in adulthood. Specifically, childhood violence exposure can disrupt the functional connectivity among brain regions that include the prefrontal cortex (PFC), hippocampus, and amygdala. Together, these regions are important for modulating autonomic responses to stress. However, it is unclear to what extent changes in brain connectivity relate to autonomic stress reactivity and how the relationship between brain connectivity and autonomic responses to stress varies with childhood violence exposure. Thus, the present study examined whether stress-induced changes in autonomic responses (e.g., heart rate, skin conductance level (SCL)) varied with amygdala-, hippocampus-, and ventromedial prefrontal cortex (vmPFC)-whole brain resting-state functional connectivity (rsFC) as a function of violence exposure. Two hundred and ninety-seven participants completed two resting-state functional magnetic resonance imaging scans prior to (pre-stress) and after (post-stress) a psychosocial stress task. Heart rate and SCL were recorded during each scan. Post-stress heart rate varied negatively with post-stress amygdala-inferior parietal lobule rsFC and positively with post-stress hippocampus-anterior cingulate cortex rsFC among those exposed to high, but not low, levels of violence. Results from the present study suggest that post-stress fronto-limbic and parieto-limbic rsFC modulates heart rate and may underlie differences in the stress response among those exposed to high levels of violence.

Development of a Medicare plan dashboard to promote health equity.

OBJECTIVE: To describe a multistage process of designing and evaluating a dashboard that presents data on how equitably health plans provide care for their members. STUDY DESIGN: We designed a dashboard for presenting summative and finer-grained data to health plans for characterizing how well plans are serving individuals who belong to racial/ethnic minority groups and individuals with low income. The data presented in the dashboard were based on CMS' Health Equity Summary Score (HESS) for Medicare Advantage plans. METHODS: Interviews and listening sessions were conducted with health plan representatives and other stakeholders to assess understanding, perceived usefulness, and interpretability of HESS data. Usability testing was conducted with individuals familiar with quality measurement and reporting to evaluate dashboard design efficiency. RESULTS: Listening session participants understood the purpose of the HESS and expressed a desire for this type of information. Usability testing revealed a need to improve dashboard navigability and to streamline content. CONCLUSIONS: The HESS dashboard is a potentially useful tool for presenting data on health equity to health plans. The multistage process of continual testing and improvement used to develop the dashboard could be a model for targeting and deciding upon quality improvement efforts in the domain of health equity.